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Abstract 

Diversity-based designing, or the goal of ensuring that web-based information is accessible to as many diverse 
users as possible, has received growing international acceptance in recent years, with many countries introducing 
legislation to enforce it. This paper analyses web content accessibility levels in Spanish education portals 
according to the international guidelines established by the World Wide Web Consortium (W3C) and the Web 
Accessibility Initiative (WAI). Additionally, it suggests the calculation of an inaccessibility rate as a tool for 
measuring the degree of non-compliance with WAI Guidelines 2.0 as well as illustrating the significant gap that 
separates people with disabilities from digital education environments (with a 7.77% average). A total of 
twenty-one educational web portals with two different web depth levels (42 sampling units) were assessed for 
this purpose using the automated analysis tool Web Accessibility Test 2.0 (TAW, for its initials in Spanish). The 
present study reveals a general trend towards non-compliance with the technical accessibility recommendations 
issued by the W3C-WAI group (97.62% of the websites examined present mistakes in Level A conformance). 
Furthermore, despite the increasingly high number of legal and regulatory measures about accessibility, their 
practical application still remains unsatisfactory. A greater level of involvement must be assumed in order to 
raise awareness and enhance training efforts towards accessibility in the context of collective Information and 
Communication Technologies (ICTs), since this represents not only a necessity but also an ethical, social, 
political and legal commitment to be assumed by society. 

Keywords: accessibility, disabilities, educational environment, eLearning, Internet 
1. Introduction 

1.1 Introduce the Problem 

The ongoing evolution of Information and Communication Technologies (ICTs) stands out as one of the essential 
features of the Information Society (Castells, 2009), which provides easy access to global communication and 
allows us to talk through boundless information systems with no physical borders (Sangra & Wheeler, 2013). 
This tendency to work with online environments rather than printed materials is certainly changing (Ali, Wahid, 
Samsudin & Idris, 2013). However, this is a change which requires constant adjustment. The temporal nature of 
knowledge requires a structure where training is replaced by staying up to date, that is, placing the latest 
developments within a real-time field (Aguirre & Manasia, 2007). 

Access to ICTs makes it possible to obtain information and communication not only more safely and easily, but 
also more quickly, regardless of our physical location (Llanos de la Hoz, 2006). Moreover, ICTs offer persons 
with a disability an opportunity for coping with the challenges in communication and socialising that they often 
encounter in their day-to-day life (Aguaded-Gomez & Perez-Rodriguez, 2012; Stendal, Balandin, & 
Molka-Danielsen, 2011). Nevertheless, gaining access to all these information and technology developments can 
actually represent a double-edged sword for people with disabilities: whilst the information is suddenly more 
accessible to many individuals, it can also raise barriers and severe obstacles for other users who cannot access 
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much of the content - for instance, when basic accessibility principles do not apply (Fairweather & Trewin, 2010; 
Rodriguez & Garcia, 2009). Flence the need for further research on the connection between people with 
disabilities and their way of accessing web content (Van Kraayenoord, 2010). 

Accessibility is a very broad concept. According to the World Wide Web Consortium (W3C), web accessibility 
means universal access to the Web regardless of the hardware, software or network infrastructure used and the 
language, culture, geographical location or abilities of users. Berners-Lee (2007) describes accessibility as “the 
art of ensuring that, to as large an extent as possible, facilities (such as, for example, Web access) are available to 
people whether or not they have impairments of one sort or another.” Along these lines, guaranteeing 
accessibility through a diversity-based design seems essential to us. Design should provide as many human 
beings as possible with the freedom required to succeed by themselves within an increasingly friendly 
environment (Aragall, 2000). It must offer solutions to ensure that professionals can satisfy the highest possible 
number of users with their creative and technical work, through awareness of and respect for all needs. 

1.2 Designing for Everyone 

Neglecting the ‘design-for-all’ model is likely to affect a large part of the population. According to the Spanish 
National Statistics Institute (INE, for its initials in Spanish) the number of Spanish nationals with a disability 
amounts to 8.5% of the total population (Note 1). All these persons need ICTs not only to enhance their abilities, 
but also to compensate possible limitations. Hence the compelling necessity to make ICTs accessible so that this 
segment of the population can take full advantage of their potential. 

The 1st Spanish National Accessibility Plan 2004-2012 (Ministerio de Trabajo y Asuntos Sociales, 2003) stated 
that “a society which fights for inclusiveness and respect for human beings must be a society which meets the 
needs of every person equally” (p. 7). Bertot and Jaeger (2006) suggested “Designing for Everyone”-set up 
under Law n. 51/2003 (2003) of Equal Opportunities, Non-Discrimination and Universal Accessibility for 
Persons with a Disability and Law n. 56/2007 (2007)-as the right way to guarantee equal opportunities for all. 

Fortunately, ICTs provide easier access to contents for people with different abilities and profiles (Prendes, 
Castaneda & Ovelar, 2014). However, the new developments in the field of technology will only benefit persons 
with a disability if emergent technologies are designed to be accessible (Zeng & Parmanto, 2004; Ritchie & 
Blanck, 2003; Baguma & Lubega, 2008). Lack of access to ICTs hampers progress towards equal opportunities, 
subsequently creating a deep cultural, economic and social divide (Serrano & Capdevila, 2011). Therefore, an 
effort must be made within ICT environments to apply the concept of universal accessibility-especially relevant 
during these times of rapid technological changes. Failing to implement this concept would not only hinder all 
the legal improvements made so far to foster equality among persons with a disability in terms of information 
society access but also prevent them from achieving their goals towards integration and independence (Jimenez, 
2011; Fairweather & Trewin, 2010). 

2. Critical Literature Review 

The W3C implemented the Web Accessibility Initiative (WAI) in order to establish Web Content Accessibility 
Guidelines (Note 2)-WCAG 1.0 and 2.0-that could regulate universal accessibility to website content. They 
include a wide range of recommendations to make web content more accessible and constitute the foundations of 
web accessibility in terms of legislation, research and development worldwide. In fact, web content can become 
accessible to a wider range of people with disabilities such as blindness and low vision, deafness and hearing 
loss, learning disabilities, cognitive limitations, limited movement, speech disabilities, photosensitivity and any 
combinations of these-and more usable to everyone too-thanks to compliance with these guidelines. 

The WCAGs revolve around 4 principles that define web accessibility. An accessible website fully conforming to 
the WCAGs should be: Understandable (its contents or operations cannot be beyond the user’s understanding); 
Operable (its interface cannot require any interactions that a user cannot perform); Perceivable (the information 
presented cannot be invisible to all of the user’s senses); and Robust (the content should remain accessible as 
technologies and user agents evolve). Following these guidelines guarantees a diversity-based design of websites 
characterised by being more accessible and beneficial to users with or without a disability. 

The aforementioned guidelines are at the root of most accessibility laws worldwide and provide the basis for 
many research studies dedicated to evaluating the accessibility degree of different websites. A number of studies 
have examined website conformance to WCAG 1.0 guidelines (see Table 1). 
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Table 1. Key studies about web content accessibility 


Study focus 

Authors 

State government websites in the USA 

Goette, Collier, and Whilte (2006) 

Lazar et al. (2010) 

Websites from four European Union states 

Marincu and McMullin (2004) 

Nepal government websites 

Shah and Shakya (2007) 

Brazilian municipalities websites 

Freire, Bittar, and Fortes (2008) 

State legislative websites in the USA 

Fagen and Fagen (2004) 

University websites in the USA 

Bradbard, Peters, and Caneva (2010); 
Krach (2007) 

International university websites 

Kane, Shulman, Shockley, and 

Ladner (2007) 

Study about website quality, which focused on blind users 

Lazar, Allen, Kleinnman, and 

Malarkey (2007) 

Determined the accessibility levels over time of several websites 
arbitrarily chosen 

Lazar and Greenidge (2006) 

Spanish and North American university libraries 

Caballero, Faba, and De Moya 
(2009) 

Suggested some straightforward assessment models for the 

Rodriguez, Codina, and Pedraza 

“cybermedia” 

(2010) 

Revised the recommendations regarding credibility assessment and 
online information accessibility 

Metzger (2007) 


It is equally important to acknowledge the efforts made by several Spanish organisations as a result of their 
strong commitment to accessible solutions at this point (Fernandez-Soria, 2013). The network for Science and 
Business Development towards Communication Accessibility (CEPAC in Spanish); the Spanish National 
Organisation of the Visually Impaired (ONCE in Spanish) or the Spanish National Institute of Technologies and 
Communication (INTECO in Spanish), have the promotion of accessibility amongst their stated objectives 
(Jimenez, 2011; Riesco, 2009; Perez, Linares, & Vizcaino, 2007; Rodriguez & Garcia, 2009; Garcia & 
Rodriguez, 2008). 

The positive implications for diversity-based design that stem from their efforts to reach accessibility are 
undeniably evident. CEPACC’s main goal is to promote research and knowledge exchange with a view to 
improve ICT accessibility. Among the actions undertaken by ONCE in the field of ICT accessibility the 
Info-Accessibility Observatory ‘Discapnet’ stands out, applying its own methodology to cany out a technical 
analysis of accessibility combined with a usability assessment based on user experience. INTECO 
simultaneously manages the Reference Centre on Accessibility and Web Standards with the support of the CTIC 
Technology Centre (Note 3) (home to the W3C Spanish Office which has developed tools such as the Web 
Accessibility Test TAW (Note 4) for the essential purpose of making the websites of Central Administration 
bodies accessible to the highest possible number of users. However, despite all these initiatives and the efforts 
made to guarantee web accessibility, further research still needs to be conducted on the actual application of the 
standard regulations. 

3. Definition of Key Terms 

The familiarity and widespread circulation of regulations and standards on web accessibility with regard to 
website and web portal design does not necessarily mean that developers always abide by those rules. It is 
therefore of paramount importance to assess the degree of compliance with these basic guidelines as well as to 
elaborate instructions to make improvements that can guarantee the diversity-based design of websites at all 
times. 
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Our paper consequently has as its main aim the provision of an overview of the current situation regarding web 
accessibility in Spanish education portals-public websites delivering multiple educational services available 
online and integrated into a single space which should legally comply with all the accessibility guidelines and 
facilitate interaction with users. 

The services and information delivered in the aforementioned web spaces provide a way of communication with 
educational community members (teachers, students and parents). Such web portals have an enormous 
educational potential and allow us to be constantly up to date with the latest developments in the field of 
education. Apart from being useful, they place information, ideas, learning resources, teaching materials, training, 
support and knowledge at everyone’s disposal. Ensuring that all these facilities are within easy reach of all users 
becomes essential and calls for a comprehensive assessment of the extent to which these portals comply with 
web accessibility standards. 

Taking all the above into account, the three specific aims of our paper are: (i) To analyse the degree of web 
accessibility in Spanish education portals using TAW as a tool; (ii) To check if educational web portals comply 
with WCAG 2.0 specifications; and (iii) To analyse if automated tools play a decisive role when trying to assess 
whether a certain website is accessible or not. 

4. Methodology 

The free-access tool TAW 2.0, which checks WCAGs in their 2.0 version, was used to conduct our examination 
of these web portals. The accessibility guidelines are divided into different success criteria, which are in turn 
classified into three conformance levels according to their impact on final website accessibility. Three levels can 
be reached, namely: A, AA and AAA, the latter being the most restrictive one and, therefore, the one which 
permits the highest accessibility level. 

In addition to establishing the three aforesaid conformance levels, TAW classifies accessibility warnings into 
three types: “Fail" (an automatically found problem which does not need a manual check; it is actually the 
violation of a guideline), “Not decided” (the problem found must be manually checked) and “Not reviewed” (it 
needs an entirely manual check). In other words, TAW may find a “Fail” warning on a web page, for instance, 
and that warning could belong to an A, AA or AAA type of guideline. 

The reasons for choosing TAW as the instrument to conduct our research are the following: it is a software 
developed by the CTIC Foundation, an organisation which houses the W3C Spanish Office; it is the most widely 
used assessment tool in Spain and one of the most frequently used tools worldwide; and it allows us to perform a 
comprehensive analysis together with automated analyses. 

The analyses and assessments carried out in the present research work focused on the study of automated 
warnings; in other words, those where the tool finds accessibility issues which do not need human supervision 
(called “Fails” by TAW) and may refer to guidelines classified as A, AA or AAA. 

The statistical data of this study are specified next. 

4.1 The Sample 

Our sample includes 21 educational web portals (links accessed from the Spanish Ministry of Education website 
(Note 5)) with two different web depth levels (Note 6)—42 in total. Such educational portals belong to the 
different Spanish Autonomous Regions, to the Ministry of Education and to the Institute of Educational 
Technology (IET in Spanish), respectively. 

4.2 Data Analysis 

The sampling plan is intentional and non-probabilistic; all sampling units contain ample qualified information. 

4.3 Assessment Tool and Analysis Criterion 

The automated analysis online software TAW was the tool used for the assessment of web accessibility in the 42 
sample items. The analysis criterion followed during the evaluation and therefore requested from TAW stems 
from the WCAG 2.0 Guidelines. 

4.5 Limitations 

Certain accessibility features can only be checked manually and are consequently beyond the scope of our 
research, which focuses on automated validation. 

The objective set in the present study was to assess automated warnings detected by TAW (i.e. those which do 
not need human supervision in order to be unquestionably regarded as violations of WCAG 2.0 Guidelines). 
Warnings belonging to the “Not decided” and “Not reviewed” types are thus left aside for other studies about 
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non-automated features. 

4.6 Qualitative Analysis 

Besides the web accessibility assessment carried out with the online software TAW, we complemented our study 
with a more qualitative approach and filmed a number of in-depth interviews with real users with a disability in 
order to explore their real needs regarding web content accessibility. Participants with visual, physical or 
auditory impairment expressed their opinions and concerns about the main challenges they tend to encounter 
when navigating, their preferences, recommendations, etc. 

5. Results 

The focus will firstly be placed on showing the general results provided by TAW that can later permit to analyse 
the degree of web content accessibility in the website examined. Figure 1 specifies the number of warnings 
reported according to typology and conformance levels, level A conformance standing out as the one most often 
violated. 
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Figure 1. Number of warnings by type and conformance level 


It can also be interred from these first general results that the “Not reviewed” type accounts for 14% of the 
warnings; 61% of the warnings are “Not decided” and the remaining 25% belong to the “Fail” type - the 
automated errors on which our assessment is based (see Figure 2). 
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Figure 2. Percentage of warnings by type 


The number of warnings on each website along with their typology clearly shows that the only website which 
does not generate automated errors is the web-depth-level-2 Madrid Regional Department of Education website. 
However, its specific accessibility level cannot be determined beforehand because that would require checking a 
high number of warnings-over 200-manually. To this must be added the fact that the web-depth-level-2 
Valencian Region website shows the highest number of errors (466), followed by the level-1 website of the 
Canary Islands, with 230 errors. 

The count of errors allows us to state that 97.6% of the websites analysed do not meet the necessary 
requirements to obtain the Level A accessibility certification (see Figure 3). Non-compliance percentage also 
exceeds 50% in the remaining two levels. 



Leve I A 


Leve IAA 


Leve I AAA 


Figure 3. Percentage of websites which do not match each conformance level 


The count of errors according to conformance level together with the calculation of an average for the 42 
sampling units gives us an average figure of 4.74 errors per website. The highest average number of 
errors-3.29-corresponds to Level A conformance; Level AA conformance shows an average of 0.55 automated 
errors per website and average Level AAA conformance sits at 0.90 errors (see Figure 4). 
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Figure 4. Average number of errors by conformance level 

5.1 WAI Checkpoints with the Highest Percentage of Errors 

Flaving shown the more general results, our attention now focuses on the checkpoints for those guidelines where 
websites fail - and the percentage that they represent over the total number of websites analysed-grouping the 
checkpoints together according to their conformance levels. 

Table 2 specifies the number of websites failing in each one of the guideline checkpoints within Level A 
conformance, as well as the percentage of websites which fail in that checkpoint with respect to the 42 websites 
analysed. It is worth emphasising at this point that the main problems which arise on this level are “1.3.1-Info 
and relationships’-violated in 69% of the websites-and “4.1.1-Parsing”-which fails in 64.3% of the websites. 

Table 2. Number and percentage of websites which fail in Level A conformance (grouped by WAI checkpoint) 


Number of failing % of 

Websites failing 

Websites 

Understandable 



3.1 Readable. 3.1.1-Language of Page 

17 

40.48% 

3.3 Input Assistance. 3.3.2-Labels or Instructions 

7 

16.67% 

Operable 



2.1 Keyboard accessible. 2.1.1-Keyboard 

8 

19.05% 

2.2 Enough time. 2.2.2-Pause, stop, hide 

1 

2.38% 

2.2 Enough time. 2.2.1-Timing adjustable 

1 

2.38% 

2.4 Navigable. 2.4.4-Link purpose (in context) 

17 

40.48% 

2.4 Navigable. 2.4.2-Page titled 

2 

4.76% 

Perceivable 



1.1 Text alternatives. 1.1.1-Non-text content 

19 

45.24% 

1.3 Adaptable. 1.3.1-Info and relationships 

29 

69.05% 

Robust 



4.1 Compatible. 4.1.1-Parsing 

27 

64.29% 

4.1 Compatible. 4.1.2-Name, role, value 

10 

23.81% 
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The 4 most frequently violated checkpoints among WCAG 2.0 guidelines are listed and described below with the 
aim of helping the reader to understand and visualize the most common accessibility errors in Level A 
conformance: 

• “1.3.1 Info and Relationships: the information, structure, and relationships conveyed through a presentation 
can be programmatically determined or be available in text. The aim of this checkpoint is to ensure that the 
information and relationships implied by visual or auditory formatting are preserved when the presentation 
format is modified. For instance, the presentation format changes when the content is read by a screen reader or 
when a user style sheet is replaced with another style sheet provided by the author. Therefore, users who are 
blind (using a screen reader) benefit when information conveyed through colour is also available through text (i.e. 
including text alternatives for images that use colour to convey information). Also, users who are deaf-blind 
using braille (text) refreshable displays may be unable to access colour-dependent information.” This checkpoint 
tends to fail in website forms with required fields, for example, as they are usually indicated with a red asterisk. 
Users with the aforementioned disabilities might not be able to perceive them. 

• “4.1.1 Parsing: elements have complete start and end tags in the content implemented using mark-up 
languages; elements are nested according to their specifications; elements do not contain duplicate attributes, and 
any IDs are unique, except where the specifications allow these features.” Failing to do so means that a user 
dependent on assistive technologies, such as a blind person using a screen reader, will not be able to access the 
content reliably as the content cannot be read properly. 

• “3.1.1 Language of Page: The default human language of each Web page can be programmatically 
determined. The goal in this checkpoint lies in ensuring that content developers provide the web page with all the 
information that user agents need to present text and other linguistic contents correctly. Both assistive 
technologies and conventional user agents can render text more accurately when the web page language is 
identified, since screen readers can load the correct pronunciation rules, visual browsers can display characters 
and scripts correctly, and media players can show captions correctly too. As a result, users with disabilities will 
find it easier to understand the content.” Failing to respect this checkpoint will make the website inaccessible to 
users who find it hard to read written material fluently and accurately and have difficulty in recognising 
characters and alphabets or decoding words and also to users with certain cognitive, language and learning 
disabilities who use text-to-speech software. 

• “2.4.4 Link Purpose (In Context): The purpose of each link can be determined from the link text alone or 
from the link text together with its programmatically determined link context, except where the purpose of the 
link might be ambiguous to users in general. This checkpoint has as its main aim to help users to understand the 
purpose of each link so that they can decide whether they want to follow the link or not.” An example of good 
design following this criterion would be: A page contains the sentence «Learn more about the Government of 
Ireland’s Commission on Electronic Voting at Go Vote!» where “Go Vote!” is a link. Users with cognitive 
limitations will not become disoriented by multiple means of navigation to and from content that they are not 
interested in, and users with visual disabilities will be able to determine the purpose of a link by exploring the 
link’s context. 

As for level AA conformance, it can be determined from our assessment that the guideline “1.4.4 Resize text” 
appears as the main issue in the dimension of the Perceptible. 54.8% of the websites fail in this checkpoint, 
which seeks to ensure that visually rendered text -including text-based controls- can be successfully scaled so 
that it can be read directly by people with mild visual disabilities without requiring the use of assistive 
technology such as a screen magnifier. Users may benefit from scaling all the contents on the web page, but text 
is most critical. 

Finally, the two accessibility checkpoints which fail the most with regard to level AAA conformance (see Table 3) 
belong to the “Operable” group: 

• “2.4.9 Link Purpose (Link Only): A mechanism is available to allow the purpose of each link to be 
identified from link text alone, except where the purpose of the link might be ambiguous to users in general. For 
example: An icon of a voting machine and the text «Government of Ireland’s Commission of Electronic Voting» 
are combined to make a single link.” 

• “2.4.10 Section Pleadings: They are used to organise the content. This checkpoint has as its aim to provide 
headings for a web page section when a page is organised into sections.” For instance, blind users will know 
when they have moved from one web page section to another and thus identify the purpose of each section; and 
users who navigate content by keyboard will be able to jump focus from heading to heading, which enables them 
to find content of interest quickly. 
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It consequently becomes obvious that failing to comply with some guidelines can affect users with various types 
of disability. Violating an easy-to-respect guideline such as giving users enough time to read and use content can 
imply the website content will remain inaccessible to users with physical disabilities, blind users or those with 
low vision, users with cognitive or language limitations, or users who are deaf and communicate using sign 
language, for example. 


Table 3. Number and percentage of websites which fail in level AAA conformance by WAI checkpoint 

Number of % of failing 
failing Websites Websites 


Understandable 



3.2 Predictable. 3.2.5-Change on request 

1 

2.38% 

Operable 



2.1 Keyboard accessible. 2.1.3-Keyboard (no exception) 

8 

19.05% 

2.2 Enough time, 2.2.4-Interruptions 

1 

2.38% 

2.4 Navigable. 2.4.9-Link purpose (link only) 

17 

40.48% 

2.4 Navigable. 2.4.10-Section headings 

11 

26.19% 


5.2 Inaccessibility Rate 

The term Inaccessibility Rate (see Figure 5) was incorporated into our research in order to measure the level of 
failure to execute WAI Guidelines 2.0. This rate reflects the proportion of checkpoints which result in a “Fail"’ 
warning over the total number of checkpoints examined. In other words, the lower this rate is the more 
accessible the assessed web page will be. Our new indicator specifies the degree of non-compliance with 
accessibility standards. 

In short. Inaccessibility Rate becomes a useful piece of information for web designers to quantitatively and 
accurately evaluate the web accessibility of their developments. 
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Figure 5. Inaccessibility rate of every website for each depth level 


Table 4 distributes the websites analysed according to their inaccessibility rate values into three differently-sized 
groups with equidistant steps and a width of five points. It deserves to be highlighted here that “10-15%” is the 
group of websites presenting the highest number of failed WAI Checkpoints. This group is formed by 12 
websites which account for 28.57% of the total number of websites examined and show an average 13.52% 
Inaccessibility Rate. 


Table 4. Segmentation of websites according to their inaccessibility rate 



Number 

of 

Websites 

% of Websites 

Average 

Inaccessibility Rate 

Most inaccessible websites. 10-15% 

12 

28.57% 

13.52% 

5-10% 

16 

38.10% 

7.99% 

Most accessible websites. 0-5% 

14 

33.33% 

2.58% 

Total 

42 

100.00% 

7.77% 


6. Discussion and Conclusion 

The main objective in our research was to obtain an overview of the current situation regarding web accessibility 
in Spanish education portals. Low web accessibility levels need to be highlighted in the first place: 54.76% of 
the websites present mistakes in level AA conformance (the minimum acceptable accessibility standard), a 
percentage that goes up to 97.62% in Level A conformance, and over 50% of websites do not match Level AAA 
conformance requirements. 

At the same time, it can be seen that the main common errors for Level A conformance are “Info and 
Relationships” and “Parsing” (with 69% and 64% of the websites failing in these two WAI checkpoints, 
respectively). This means not only that more than half of the portals do not provide the information, structures 
and relationships in their presentations which could be offered differently (through text, audio or visual) but also 
that over 50% of them use language, marks or tags which can lead users to make mistakes. As for Level AA 
conformance, the checkpoint “Text Resize” fails in 54.8% of the websites analysed, which shows that text cannot 
be resized in any of these websites without the support of additional technology. The two checkpoints which fail 
the most with regard to Level AAA conformance are “Link Purpose” and “Section Headings;” 40.48 % of the 
websites do not have a mechanism which permits the identification of the purpose of each link through text, and 
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26.19% fail when using headers or titles to organize content. 

Our research also has as its second objective to check the extent to which educational web portals comply with 
the WCAG 2.0 Guidelines. Out of 42 sampling units analysed, only the web-depth-level-2 Madrid Regional 
Department of Education website matches all three automated levels. On the whole, results reveal the presence 
of considerable accessibility barriers that go against the suggestions of the international consortium in the rest of 
samples assessed. 

Finally, our third objective, which consisted in verifying that the assessment of automated web accessibility is 
essential when it comes to determining the extent to which web spaces are accessible, has been proved both by 
our results and by the findings of previous studies. 

Previous literature also used automated tools to examine websites in search of web accessibility-related problems. 
After admitting the limitations of automated analysis, several authors reached the conclusion that if a certain 
level is not obtained with an automated tool, that level cannot possibly be reached manually (Freire, Bittar, & 
Fortes, 2008; Vigo & Brajnik, 2011; Buhler, Fleck, Perlick, Nietzio, & Ulltveir-Moe, 2006). The results obtained 
in our study match the uniformly negative trends for diversity-based design of other research studies. Zeng and 
Parmanto (2004) checked that website inaccessibility was widespread and also found a correlation between 
accessibility web barriers and the popularity of a website (the variable representing the popularity of a website 
was measured by its visit traffic). 

These authors found the correlation between accessibility web barriers and the popularity of a website to be 
statistically significant (r = 0.28, P < 0.05). The main reasons for this accessibility-popularity correlation actually 
include the possibility that people become aware that a website is accessible and thus tend to visit it often, or that 
web developers of accessible websites spend more time making sure that their websites are appropriate in 
following other usability rules that make visiting easier for the public. 

Lazar and Greenidge (2006) also argued that an accessible website increases the number of users, which in turn 
improves the organisation’s profit. This supports the idea that complying with standards is beneficial not only to 
Internet users but also to website developers and owners (Bravo, 2006) and highlights the benefits of 
diversity-based design. In keeping with our conclusions, the analysis of 62 Catalan library websites carried out 
by Lopez, Mendez, and Sorli (2002) showed that 90% of them did not meet some of the WGAG 1.0 
requirements. 

One would expect web accessibility to be gradually improving, but the most recent studies in this field show that 
there is still a long way to go. According to the information provided by the Info-accessibility Observatory 
Discapnet in 2008, only 36% of town hall portals in Spanish provincial capitals fulfill the basic accessibility 
requirements of diversity-based design. 

A similar situation exists in the international context: Petrie, King, and Flamilton (2005) proved that less than 
half of the English museum web portals, libraries and archives analysed comply with the basic accessibility 
guidelines. In turn, Marincu and McMullin (2004) automatically demonstrated with a total of 5,000 samples that 
94% of UK websites and 95% and 98% in Germany and France respectively, did not match Level A 
conformance guidelines. Finally, Goette et al. (2006) found that 98% of the 50 websites in the state of Columbia 
analysed were not accessible either. 

Krach (2007) compared the data obtained from an automated assessment which covered the websites of 50 North 
American universities with the data collected by Zaphiris and Ellis (2001) about the same universities; 30% of 
these universities met Level A conformance in 2001, a percentage which rose to 58% in 2007. Kane et al. (2007) 
showed that 100 websites from international universities had several accessibility obstacles. Authors like 
Bradbard et al. (2010) also acknowledge this trend, recognising generalised inaccessibility in North American 
university websites. In fact, accessibility still represents a problem for a wide range of public administration web 
portals. 

A review of the previous literature together with the results of the present research work leads us to reach the 
following conclusions: 

1) This study set out to determine the degree of web accessibility in Spanish education portals. After conducting 
our study with TAW, it becomes obvious that accessibility levels are low despite the current information and 
communication policies in Spain, according to which the creation of technologies, products and services must 
always follow accessibility principles. 

2) The results of this study show that education web portals do not comply with WCAG 2.0 specifications. As 
suggested by the findings, the level is still far from satisfactory since web designers have not met the basic 
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accessibility guidelines which define web accessibility. 

3) Another significant finding that emerges from our study is related to whether automated tools are decisive 
when trying to assess a website’s accessibility. The accessibility analysis performed in our study proves the 
effectiveness of automated validation to check that web portals are not accessible. 

These findings have a number of important implications for future practice and suggest several courses of action 
for different professional groups: 

1) Web designers should increase their efforts to respect the common web accessibility guidelines. Although new 
technologies, the rise of User-Generated Content (UGC) and the neutrality of accessibility guidelines pose a 
professional challenge for developers in search of accessibility solutions, the strongly committed activity of 
institutions such as W3C provides the developers’ community with a wide range of solutions and technological 
guidelines. 

2) Public institutions must guarantee that the content of their websites is accessible to all citizens. Unless 
governments adopt these guidelines as a reference for public websites, universal web accessibility will never be 
attained. Web accessibility is not only a necessity but also an ethical, social, political and legal commitment to be 
assumed by society. 

3) Although the number of legal and regulatory measures about web accessibility is increasingly high, their 
practical application still remains unsatisfactory. That is why disability advocate groups should continue to use 
high-impact litigation in order to secure the right to equal opportunities for people with various types of 
disabilities. 

These conclusions are in agreement with the opinion of the users that participated in the assessment sessions.. 
Even though it is beyond the scope of this article to analyse these interviews thoroughly, it could be enlightening 
to remark on some of the opinions regarding the users’ difficulties to access web contents. One of the recurrent 
feelings was indignation, and one of the participants manifested how “it seems that logics and the Internet are not 
compatible” (Participant 1). We could perceive a generalised frustration with the lacking financial investment 
made on accessibility solutions and with the way in which governments “generally spend on other things which 
may not be so necessary or don't infringe so much the right of a person to exercise their citizenship” (Participant 
2). There is a generalized sentiment of unsatisfaction and a thirst for improvement and for a steady advancement 
towards quality accessibility solutions. 

Improving web accessibility actually means improving the foundations of a twenty-first-century society as well 
as consolidating the actual Web 2.0 approach, which gives priority to applications devised to facilitate 
information sharing, interoperability, user-centred design and Web-based collaboration. In this respect, 
diversity-based design must be understood as an essential method for the creation of an egalitarian society where 
every citizen can participate on an equal footing. The design of accessible products needs to be promoted, thus 
making an effort to meet the needs of the highest possible number of users as far as access to the Internet is 
concerned. 
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Notes 

Note 1. www.ine.es Data drawn from the 2008 Survey on Disability, Personal Autonomy and Dependency 
Situations 

Note 2. Available at http://www.w3.org/TR/WCAG/ 

Note 3. Innovation and Communication Technology Centre (www.fundacionctic.org) 

Note 4. http://www.tawdis.net 

Note 5. http://ares.cnice.mec.es/matematicasep/pb/enlaces/comunidades.html (Consulted on April 24, 2014) 

Note 6. Web depth level reflects the number of clicks needed to reach a page within a website. By way of 
example, accessing a page which is on web depth level 2 within a website or web portal requires one click (or 
clicking on one link) on the website homepage. Therefore, web depth level 1 corresponds to any content found 
on the homepage without clicking anywhere having needed any clicks. 
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